Journals
  Publication Years
  Keywords
Search within results Open Search
Please wait a minute...
For Selected: Toggle Thumbnails
Order dispatching by multi-agent reinforcement learning based on shared attention
Xiaohui HUANG, Kaiming YANG, Jiahao LING
Journal of Computer Applications    2023, 43 (5): 1620-1624.   DOI: 10.11772/j.issn.1001-9081.2022040630
Abstract351)   HTML10)    PDF (1392KB)(189)       Save

Ride-hailing has become a popular choice for people to travel due to its convenience and speed, how to efficiently dispatch the appropriate orders to deliver passengers to the destination is a research hotspot today. Many researches focus on training a single agent, which then uniformly distributies orders, without the vehicle itself being involved in the decision making. To solve the above problem, a multi-agent reinforcement learning algorithm based on shared attention, named SARL (Shared Attention Reinforcement Learning), was proposed. In the algorithm, the order dispatching problem was modeled as a Markov decision process, and multi-agent reinforcement learning was used to make each agent become a decision-maker through centralized training and decentralized execution. Meanwhile, the shared attention mechanism was added to make the agents share information and cooperate with each other. Comparison experiments with Random matching (Random), Greedy algorithm (Greedy), Individual Deep-Q-Network (IDQN) and Q-learning MIXing network (QMIX) were conducted under different map scales, different number of passengers and different number of vehicles. Experimental results show that the SARL algorithm achieves optimal time efficiency in three different scale maps (100×100, 10×10 and 500×500) for fixed and variable vehicle and passenger combinations, which verifies the generalization performance and stable performance of the SARL algorithm. The SARL algorithm can optimize the matching of vehicles and passengers, reduce the waiting time of passengers and improve the satisfaction of passengers.

Table and Figures | Reference | Related Articles | Metrics
Clustering algorithm based on local gravity and distance
Jie DU, Yan MA, Hui HUANG
Journal of Computer Applications    2022, 42 (5): 1472-1479.   DOI: 10.11772/j.issn.1001-9081.2021030515
Abstract315)   HTML13)    PDF (3200KB)(161)       Save

The Density Peak Clustering (DPC) algorithm cannot accurately select the cluster centers for the datasets with various density and complex shape. The Clustering by Local Gravitation (LGC) algorithm has many parameters which need manual adjustment. To address these issues, a new Clustering algorithm based on Local Gravity and Distance (LGDC) was proposed. Firstly, the local gravity model was used to calculate the ConcEntration (CE) of data points, and the distance between each point and the point with higher CE value was determined according to CE. Then, the data points with high CE and high distance were selected as cluster centers. Finally, the remaining data points were allocated based on the idea that the CE of internal points of the cluster was much higher than that of the boundary points. At the same time, the balanced k nearest neighbor was used to adjust the parameters automatically. Experimental results show that, LGDC achieves better clustering effect on four synthetic datasets. Compared with algorithms such as DPC and LGC, LGDC has the index of Adjustable Rand Index (ARI) improved by 0.144 7 on average on the real datasets such as Wine, SCADI and Soybean.

Table and Figures | Reference | Related Articles | Metrics
Iterative Hard Thresholding Orthogonal Projection under Cosparsity Analysis Model
ZHANG Zongnian LI Jinhui HUANG Rentai YAN Jingwen
Journal of Computer Applications    2013, 33 (08): 2387-2389.  
Abstract452)      PDF (624KB)(328)       Save
To reconstruct the original signal from a set of linear measurements with noise, the cosparsity analytical model theory was analyzed and the hard thresholding orthogonal projection algorithm under the cosparsity analysis model was proposed. The cosparsity orthogonal projection strategy was used to improve the iterative process for the proposed algorithm, and the methods for selecting iterative step size and the length of cosparsity were given. The sufficient condition of convergence for the algorithm and the reconstructed signal error range between the reconstructed signal and the original one were provided. The experiments show that the CPU running time of the algorithm is only equal to 19%, 11% and 10% of AIHT, AL1 and GAP algorithms, and the average Peak Signal-to-Noise Ratio (PSNR) of reconstructed signal improves 0.89dB than that of AIHT but degrades a little bit than that of AL1 and GAP. It is concluded that the proposed algorithm can reconstruct the signal with Gaussion noise in high probability with very short running time or faster convergence speed than that of the current typical algorithm when some conditions are satisfied.
Related Articles | Metrics
Network protocol reverse parsing technique based on dataflow analysis
DAI Li SHU Hui HUANG Hejie
Journal of Computer Applications    2013, 33 (05): 1217-1221.   DOI: 10.3724/SP.J.1087.2013.01217
Abstract865)      PDF (825KB)(781)       Save
Reverse parsing unknown network protocol is of great significance in many network security applications. Most of the existing protocol reverse parsing methods can not handle the encryption protocol or get the semantic information of the protocol field. To solve this problem, a network protocol parsing technique based on dataflow analysis was proposed. According to the data flow recording tool developed on Pin platform, it could parse the network protocol with the aid of the dependence analysis based data flow tracking technology, as well as obtain the protocol format and semantic information of each protocol field. The experimental results show that the technique can parse out the protocol format correctly, especially for the encryption protocol, and extract the program behavior semantics of each protocol field.
Reference | Related Articles | Metrics
New rapid algorithm for detecting girth of lowdensity Paritycheck codes
LI Jiong-cheng LI Gui-yu XIAO Heng-hui HUANG Hai-yi
Journal of Computer Applications    2012, 32 (11): 3100-3106.   DOI: 10.3724/SP.J.1087.2012.03100
Abstract1178)      PDF (493KB)(413)       Save
Concerning the girth problem of LowDensity ParityCheck(LDPC) codes, a new rapid algorithm for detecting the girth of LDPC codes in combination with Dijkstra algorithm and the feature of Tanner graph was proposed, and the time complexity of this algorithms was lower. Compared with known algorithms, this algorithm not only can calculate rapidly, but also return the girth and edges only one time, thus avoiding redundant computation. At last, the simulation verifies the feasibility and efficiency of this new algorithm.
Reference | Related Articles | Metrics
Research on temporal and spatial distribution of online users in P2P TV
JIANG Zhi-Hong WANG Hui HUANG Bing LI Pei FAN Peng-yi
Journal of Computer Applications    2012, 32 (07): 2022-2026.   DOI: 10.3724/SP.J.1087.2012.02022
Abstract992)      PDF (879KB)(741)       Save
Direct towards anonymity and high dynamic of online user in P2P TV, a P2P TV crawler, called TVCrawler was developed and deployed which enabled to launch an active measurement on several popular large scale P2P TV systems. The authors conducted a comparative research on time evolution and geographic distribution of online users in these different P2P TV systems. First, while intuitively researching the time evolution of online users in P2P TV channel, the method of MultiScale Entropy (MSE) analysis was introduced to investigate the complexity in time series of the number of online users. Second, the authors made a study on the regular pattern of online users' geographic distribution, and made a Google map-based visual representation about online users. Then, by analyzing the relationship between geographic distribution of online Chinese users and provincial economic development level of China, it is discovered that significant linear decreasing correlation exists between the two of them.
Reference | Related Articles | Metrics
WSMF model: Elements decomposed and expressed in code
Ying-Hui HUANG Guan-Yu LI
Journal of Computer Applications   
Abstract1688)      PDF (683KB)(952)       Save
Based on correctly understanding the essence of Web Services Modeling Framework (WSMF), the practical application of WSMF should be summarized to decomposing and coding the WSMF elements. The WSMF is essentially an entity containing four toplevel elements called the Web services, goal, mediator, Ontology, and their interactive relations. The elements and their relations of WSMF are derived from the viewpoints of reusability, decoupling, and semantic mediation service, and are refined and expanded into a hierarchical system of bottomlevel elements according as Web Services Modeling Ontology (WSMO). The WSMF bottomlevel elements are formalized in description by using Web Services Modeling Language (WSML), and then transformed into XML code. An actual Web service is given to illustrate the methods and the process of decomposing and coding the WSMF toplevel elements.
Related Articles | Metrics